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Application No. 

09/647,266 



Examiner 

Chongshan Chen 



Applicant(s) Q^-^ 



SHARPE ET AL 



Art Unit 

2172 



- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 IVIONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time nnay be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )□ Responsive to communication(s) filed on . 



2a)n This action is FINAL. 2b)S This action is non-final. 

3) 0 Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 
Disposition of Claims 

4) ^ Claim(s) 1-17 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) 0 Claim(s) is/are allowed. 

6) S Claim(s) 1-17 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10) n The drawing(s) filed on is/are: a)n accepted or b)^ objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 

11) 0 The proposed drawing correction filed on is: 3)0 approved b)n disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) 0 The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

1 3) K1 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 

a)l3 All b)n Some * c)^ None of: 

1 .13 Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) n Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 11 9(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) n Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121, 
Attachment(s) 

1) lEl Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) Paper No(s). . 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) □ Notice of Infomnal Patent Application (PTO-152) 

3) ^ Information Disclosure Statement(s) (PTO-1449) Paper No(s) 6 . 6) □ Other: 
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DETAILED ACTION 



Claim Rejections - 35 USC §103 



1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

2. Claims 1-17 are rejected under 35 U.S.C. 103(a) as being unpatentable over Nelson et al. 
["Nelson", 6,243,713 Bl] in view of Herz [6,460,036 Bl]. 

As per claim 1, Nelson discloses a method of searching a database to find documents 
similar to a query document, comprising: 

decomposing the query document into elements of different data types (Nelson, col. 5, 
lines 52-55, "Compound documents are separated into constituent multimedia components of 
different data types, such as text, images, video, audio/voice, and other data type."); 

for one or more of the elements in a first data type, conducting a first data type similarity 
search to return match results from the database for the one or more elements in the first data 
type; for one or more of the elements in a second data type, conducting a second data type 
similarity search to return match results from the database for the one or more elements in the 
first data type (Nelson, col. 22, lines 31-34, "require the different types of multimedia 
components to be separately scored and evaluated, with separate queries"); 

combining the match results from the first data type similarity search and the second data 
type similarity search to provide query document match results (Nelson, col. 22, lines 31-34, "the 
results of which are combined"). 



Application/Control Number: 09/647,266 Page 3 

Art Unit: 2172 

Nelson does not explicitly disclose the multimedia document is submitted by a user. 
Herz discloses a profile searching method that the query document is submitted by a user (Herz, 
col. 56, lines 23-25, "using copies of the profiles of target objects or target clusters that the user 
indicates are representative of his or her interest"). Therefore, it would have been obvious to one 
of ordinary skill in the art at the time the invention was made to combine Herz with Nelson in 
order to free the burden of a user by allowing the user to submit a query document instead of 
typing the query. 

As per claim 2, Nelson and Herz teach all the claimed subject matters as discussed in 
claim 1, and further discloses one of the data types is representative of text (Nelson, col. 5, lines 
52-55, "Compound documents are separated into constituent multimedia components of different 
data types, such as text, images, video, audio/voice, and other data type."). 

As per claim 3, Nelson and Herz teach all the claimed subject matters as discussed in 
claim 2, and further discloses a plurality of the data types are representative of text, separate data 
types of the plurality being representative of different functional blocks of text (Nelson, col. 5, 
lines 52-55). 

As per claim 4, Nelson and Herz teach all the claimed subject matters as discussed in 
claim 1, and further discloses one of the data types is representative of pictorial images (Nelson, 
col. 5, lines 52-55). 

As per claim 5, Nelson and Herz teach all the claimed subject matters as discussed in 
claim 1, and further discloses one of the data types is representative of graphical images (Nelson, 
col. 5, lines 52-55). 
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As per claim 6, Nelson and Herz teach all the claimed subject matters as discussed in 
claim 1, and further discloses text, images, video, audio/voice, and other data type (Nelson, col. 
5, lines 52-55) which inherently includes data types representing the arrangement of other data 
types within the document. 

As per claim 7, Nelson and Herz teach all the claimed subject matters as discussed in 
claim 1 , and further discloses the step of similarity searching to return match results is carried 
out, separately, for a plurality of elements having between them more than two data types 
(Nelson, col. 22, lines 31-34). 

As per claim 8, Nelson and Herz teach all the claimed subject matters as discussed in 
claim 1, and further discloses all features of a common data type in the document are treated as 
one element (Nelson, col. 6, lines 1-34). 

As per claim 9, Nelson and Herz teach all the claimed subject matters as discussed in 
claim 1, and further discloses spatially distinct features of a common data type in the document 
are treated as separate elements (Nelson, col. 6, lines 1-34). 

As per claim 10, Nelson and Herz teach all the claimed subject matters as discussed in 
claim 1, and further discloses elements are user selectable or deselectable for the step of 
similarity searching (Nelson, col. 18, lines 1-10). 

As per claim 1 1, Nelson and Herz teach all the claimed subject matters as discussed in 
claim 1, and further discloses the similarity searching resuhs for separate elements are weighted 
before combination (Nelson, col. 22, lines 31-34). 

As per claim 12, Nelson and Herz teach all the claimed subject matters as discussed in 
claim 1 1, and further discloses weighting is user selected (Nelson, col. 22, lines 1-6). 
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As per claim 13, Nelson and Herz teach all the claimed subject matters as discussed in 
claim 1 1, and further discloses weighting is attributed according to a determined significance of 
each relevant element in the document (Nelson, col. 21, lines 1-53). 

As per claim 14, Nelson discloses a method of searching a database to find documents 
similar to a query document, comprising: 

decomposing the query document into elements of different data types (Nelson, col. 5, 
lines 52-55, "Compound documents are separated into constituent multimedia components of 
different data types, such as text, images, video, audio/voice, and other data type."); 

determining a layout element in a layout datatype from the spatial arrangement of the 
elements in the document; and for the layout element, conducting a layout similarity search to 
return match results from the database for the layout element (Nelson, Fig. 3, col. 6, lines 35-65). 

Nelson does not explicitly disclose the multimedia document is submitted by a user. 
Herz discloses a profile searching method that the query document is submitted by a user (Herz, 
col. 56, lines 23-25, "using copies of the profiles of target objects or target clusters that the user 
indicates are representative of his or her interest"). Therefore, it would have been obvious to one 
of ordinary skill in the art at the time the invention was made to combine Herz with Nelson in 
order to free the burden of a user by allowing the user to submit a query document instead of 
typing the query. 

As per claim 15, Nelson and Herz teach all the claimed subject matters as discussed in 
claim 14, and further discloses the layout similarity search involves searching against templates 
representative of different document types (Nelson, col. 8, lines 21-67). 
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As per claim 16, Nelson and Herz teach all the claimed subject matters as discussed in 
claim 14, and further discloses the elements include elements of separate data types 
representative of different functional blocks of text (Nelson, coL 5, lines 52-55). 

As per claim 17, Nelson and Herz teach all the claimed subject matters as discussed in 
claim 14, and further discloses the elements include elements of data types representative of 
images (Nelson, col. 5, lines 52-55). 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Chongshan Chen whose telephone number is (703) 305-8319. 
The examiner can normally be reached on Monday - Friday (8:00 am - 4:30 pm). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kim Y Vu can be reached on (703)305-4393. The fax phone numbers for the 
organization where this application or proceeding is assigned are (703) 746-7239 for regular 
communications and (703) 746-7238 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is (703)305-3900. 



Conclusion 



CC 

February 6, 2003 




SUPERVISORY PATENT EXAMINER 
TECK\!0L06Y CENTER 2100 



